ZstGAN: An adversarial approach for Unsupervised Zero-Shot Image-to-image Translation

نویسندگان

چکیده

Image-to-image translation models have shown remarkable ability on transferring images among different domains. Most of existing work follows the setting that source domain and target keep same at training inference phases, which cannot be generalized to scenarios for translating an image from unseen another domain. In this work, we propose Unsupervised Zero-Shot Translation (UZSIT) problem, aims learn a model can translate samples domains are not observed during training. Accordingly, framework called ZstGAN: By introducing adversarial scheme, ZstGAN learns each with domain-specific feature distribution is semantically consistent vision attribute modalities. Then domain-invariant features disentangled shared encoder generation. We carry out extensive experiments CUB FLO datasets, results demonstrate effectiveness proposed method UZSIT task. Moreover, shows significant accuracy improvements over state-of-the-art zero-shot learning methods FLO.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Unsupervised Image-to-Image Translation with Generative Adversarial Networks

It’s useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the ”image-to-image translation” problem, and propose a general approach to achieve it, based on deep convolutional and conditional generative adversarial networks (GANs), which has gained ...

متن کامل

Unsupervised Image-to-Image Translation Networks

Unsupervised image-to-image translation aims at learning a joint distribution of images in different domains by using images from the marginal distributions in individual domains. Since there exists an infinite set of joint distributions that can arrive the given marginal distributions, one could infer nothing about the joint distribution from the marginal distributions without additional assum...

متن کامل

In2I : Unsupervised Multi-Image-to-Image Translation Using Generative Adversarial Networks

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-toimage translation problem to multiple input setting. Given a set of paired images from multiple modalities, a transformation is learned to translate the input into a spe...

متن کامل

Zero-Shot Sketch-Image Hashing

Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity search. Providing training and test data subjected to a fixed set of pre-defined categories, the cutting-edge SBIR and cross-modal hashing works obtain acceptab...

متن کامل

Unsupervised Image Translation

An interesting and potentially useful vision/graphics task is to render an input image in an enhanced form or also in an unusual style; for example with increased sharpness or with some artistic qualities. In previous work [10, 5], researchers showed that by estimating the mapping from an input image to a registered (aligned) image of the same scene in a different style or resolution, the mappi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2021

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2021.07.037